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ABSTRACT 

An evaluation was done of New York City Public 
Schools' Project Aprendizaje, which served disadvantaged, immigrant, 
Spanish-speaking high school students at .Seward Park High School in 
Manhattcin. The Project enrolled 290 students in grades 9 through 12, 
93.1 percent of whom were eligible for the Free Lunch Program. The 
Project provided students of limited English proficiency with 
instruction in English as a Second Language (ESL) , native language 
arts (NLA) , and content area subjects taught bilingually or in 
English with an ESL roethtxJology . The project arranged activities for 
staff development and parental involvement and provided tutoring and 
informal counseling in the project office. Staff reported that the 
Project was integrated with activities at the school. Evaluation of 
the program was based on demographic data, citywide student test 
scores, and interviews with and surveys of the program director. 
Project Aprendissaje met its objectives for career educal on, 
attendance, suspension rate, dropout prevention, suppoi-t services, 
staff development, and content area subjects. The Project met the ESL 
objective in the fall, but missed it in the spring by a narrow 
margin. It met one of two NLA objectives, smd partially met its 
newsletter objective. Two appendices summarize the data collection 
and analysis methods and list instructional materials for the content 
areas. (JB) 
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FOREWORD 



The body of this report is preceded by an Extract whkrh pre^nts an overview of saliciil points of 
the project: funding cyde; enroUment f^res; t^ckground of students served; admission criteria; and 
programming features, strengths, and Iimitatk>ns, including the outcome of all objectives. The extract 
presents the conclusions drawn hy the Offce of Resean^h, Evaluation, and Assesanent (OREA) about the 
program and its recommenddtk)ns for program improvement. 

The enract is foIk>wed by the body of the report, titled Program Assessment . This includes such 
information as staffing, program imptemeniation, and outccnne and imp{ementatk»n objectives. 
Instructional objectives are presented first, followed by noninstnKnk>nal objectives. The report then 
addresses those ai^pem of programmmg mandated by Htle VII regttlaiions that do not have specifically 
stated objectives. This may be tnformatk>n on attendance and (kopout rate, grade retentk>n, 
mainstreaming, referrals out of the program to meet ^>^al needs of the students, and withdrawals. A 
case bistoiy concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which arc 
described in the A ppendix following the text. 
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EXTRACT 



PROJECT DIRECTOR : Marisa Carbooara 

School Borough 
Seward Park School Manfaattaa 



Grade Levels 



9-12 



FUNDING CYCLE: Year 3 of 5 



^arpllineiU 



197 



Hie project enrolled 290 students (27 more than in the prevk>us year). 



(spring) 
138 



S llJDENT BACKGROUND 

Native Languag e Number of Students 

Spanish 290 



Countries of Ori gin 
Cok>mbia 

Domimcan Republic 

Ecuador 

EI Salvack)r 

Honduras 

Memo 

Panama 

Puerto Rico 

Venezucis 

Other countries 



Number of Students 
2 

205 
7 
6 
3 

10 

31 
5 

19 



Mean Years of Educairon in Native Coamfv : 7.87; in the United ^ta| ey 2.30 

Percentage of Students Eligible for Free Lunch Program: 93.1 

Most project students came from impoverished rural areas in the Dominican Republic. Many had noi 
finished eiemtntaiy school. Once in New York, many of Ihem helped supfx^rt their families by working after 
!>chooi and so had little time for home^^rk. 



ADMISSION CRITERIA 

The project admitted ^anisfa-speaking students who scored at or below the 40th percentile on the 
English Language Assessment Battery (LAB). Project staff tested students' Engii^ skills in greater detail for 
placement within the program. 
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FROGRAMMING 



Fcaiurys 

Project Aprendizaje provided Spanish-speakiog h^h scbool students of limited English proficiena (LHP) 
with instructioii in En^idi 9 > a Second Language (E^S.L), Native Language Arts (N1..A.), and content area 
subjects taught btlingually o* in English with an E.S.L, n^thodology. The project arranged activities for staff 
development and parental invotvement and provided tutormg and informal counseling in the project offsce. 

Strengths and Limitatfons 

Project staff reported that Project Aprendizaje was effectively integrated with activities at Se^^ard Park 
High School. The project's bilingual bu^ess preparation courses took advantage of the schoofs ample computer 
resources. Project sta^ assi^ the school with translation and interpretatkni and coordinated extracurricular 
activities with the mainstreai. . rogram* Hiey reported that the schcol K^ranan consulted with them regularly in 
order to meet the needs of project students. 

Twenty stuctents passed the Advanced Placement a;aminalk)n in furnish; a Project Aprendizaje student 
^x>n the citywide Spanish spe) ing contest held at the office of the New York City Publkr Schools; 35 out of 36 
pn^ject stui^nts in the ^nior iass graduated. 

Because of an unexpected reduction in available funds, the project did not publish a second newsletter as 
proposed or replace textbooks as planned. 

CONCLUSIONS AND RECOMMENDATIONS 

Project Aprendizaje met its objectives for career education, attendance, su^nsion rate, dropout 
prevention, support servkres, staff development, and content area subjects. The project met the G.S.L. objective in 
the faQ but missed it in the spring a narrow mai^in. It met one of two N.L.A objectives and partially met its 
newsletter objecth^e* 

The project social worker contaaed parents via telephone, mail, newsletters, or home visits, thus meeting 
this parental invobemeni objective. The project did not provide data to evaluate parents' attendance at the 
Bilingual Parent Advisoiy Council or parent-teacher conferences. Data were also unavailable for ORHA to assess 
project students' partkri{.ation in extracurricular activities as compared to mainstream students, 

llie conclusion:^ based on the Hndings of this evatuatk>n, lead to the following recommendations: 

• Provide OREA with all data necessary to evaluate objectives* 

• Seek ways of cfcKumenting parental involvement activities. 

• Revise the objective for ^racurricular activities so that it can be evaluated. 

• E:q>k>re more ways in which to meet the objectives for E.S.L. and N.L.A. 



PROGIUM ASSESSMENT 



STAPHNG 

lltlc VII Slaff (Total 5) 
Title 



De gree 



Currkniium Resource Special^t B.A 

Educdibnal Assistant High Schooi+ 

Educatk>aal Assistant High School + 

Educatbna! Assistant A.A. 

Educatk>nal A^tant High ScbooH 

Project Staff Not Funded bv Title VII (Total 2) 



Project Director 
Resource Specialist 



M.A. 



Oihcr Staff Working with Project Students (Total 50) 



Titles Degrees 

Assist. Principal 1 Ph.D. 1 

Dean 1 M.A. 2 

Teacher 40 B.A, 2 

Social Worker 1 

Guid. Counsetor 1 

Paraprofcssional 6 



Language Competencies 

Spanish 
Spanidi 
Spanish 
Spaiush 
^>an^ 



Spanish 
^>ani^ 



Funding 

Part time 
Full time 
Full time 
Full time 
Full time 



Tax levy- 
Tax levy 



Certifkrations 

E.S.L 18 

Spanbh 5 

History 4 

Mathematics 5 

Science 3 

BusXareer Ed. 5 

Counseling 1 



TeachingiCommunicative 
Proficiencies f TP.tTP) 

Spanish TP 19, CP 6 



Degrees are listed for administrative and support staff only. Project estimated that 80 percent of the 
teachers of partk::pating students held master's degrees. 



All but one of the teachers held certifk:ation in the areas they were teaching. 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 

English as a Sea>nd Language (E.S.L^ 

Level Periods Weekly 

Beginning 10 
Inttnn^Uate 5 
Advanced 5 
TransitioQal 5 

E.S.U instructors reported using a wide variety of strategies. In addition to audioUngual drill and 
grammatH:al analysis^ teachers used role-playing, debates, and games such as Carolyn Graham's Jazz CTiants. 



*Teaching Ptofidency (TP): Competent to teach in this language. 
Communicative Proficiency (CP): Conversational capability only. 



ITiey also died James Asher s Toiat Pfaysfcal RespQpsc , Caleb Galicgno*s Silent Wav> and Tracy TcrreU*s Natural 
A pproach . Students used the folk>wing texts and workbooks: 



Passage to E>SX. Literacy 
English for a Changiag World (hV) 

Skffl Sharpeners 
Write From the Start 
Compositfon Practice (2nd ed^ 



J. DeFilippo, C Skidmore 
D. Davidson, D. Bk)t 
Linda L. Blantoo 



Dbne LongfleM 
Caroline Banks 
lantomo, Papa 



• As a result of partk^pating in the prc^ram, 70 f^rcent of E.S.L. students at all levels will achieve a 
pas^ng grade of 65 or nK>re on teacher-made fmal examinatbns. 

Of the 172 students who enrolled in E.S.L. in the fall semester, 75.6 percent received passing grades. Of 
the 111 who enrolled in the ^ring, 68.5 percent received pas^g grades. 

Project mtt Directive in the foil but net la the spring. 



Native Language Arts (N.L.A.) 

Level Periods Weekly 

Beginning 5 

Intermediate 5 

Advanced 5 

Advanrad Placement 5 

Students used the following texts: 



• As a resuh of partknpating in the program, students will show statisttcally significant gains as 
measured pre- and pc^t-asses^ents with the appropriate level of La Prueba de Leciura. 

The project received permisi^n from the Offoe of Bilingual Educatk>n and Minority language Affairs 
(OBEMLA) to substitute the Language Assesraient Battery (LAB) to evaluate this objective. 

Hvaiuaiion Instrument: Language Assessment Battery, Spanish ver&bn* 

Pretest: March, 1990; posttest: March, 1991 

Number of students for whom pre- and posttest data were reported: 14 



*OREA used a gap reductbn des^n to evaluate the effect of suppienMOtaiy instruction on project students* 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no valid 
comparison group esmts aoiong these studenu, and OREA used instead the group on which the LAB was 
normed. Test scores are reported in Normal Curve Equivalents (N.C.Es)^ which are normalized standard scores 
with a mean of 50 and a standard deviatk>n of 21.06. It is a^med that the norm group has a zero gain in 
N.C.E.s in the at^nce of supplementary instruction and that partk^ating students' gains are aitributablc to 
project services. 



EspaflolS 

Levendas Hiroanoameric^nas 
Es paflol para el Biliogfle 
Galeria Huq>anica 
Caleittoscooio 



J. L. Igartera 
Bark>w & Genovese 
Barker, M. 
Lado 

Martm et al. 



Tabemera 
National Textbook 
Natk)na] Texibi>ok 
McGraw-Hill 
Ginn 
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Meangaia: 1.9 N.CE.s (s.d.=:23,6) 



Mean gain is not statistkalK significant (t^0.31, g>.05) 
Project did not meet objertive. 

• Sevent>'-rive percent of the students in the Advanced Placement Spanish class will achieve a passing 
grade of at least 75 on a teacher*Diade Hnal examination and on the Advanced Placement 
examinations in May for college credit. 

Of the 26 students in the class, 20 took ihe Advanced Placen^nt examination. Nineteen achicv cd a saire 
of 4 or 5 out of a possible 5. 

Project met objective. 

Content Area Subjects 

All content area courses provided Ove periods of instruction a week. 

Computer literacy, sequential matbematks I, bbtogy, gk>bdl history, and Amerkan government %%'cre 
taught in Spanish. Other content area courses, as well as business typing and business job skills* were taught 
MItngually or with an E.S.L. methcHiok^gy. 

There were not enough bilingual teachers at Seward Park H^h School to meet the needs of all the L1:P 
students, so the school ass^ed the available bilingual staff to ninth and tenth grade courses. In the eleventh and 
twelfth grades, most project students took at least ^me content area courses in the mainstream. Hiose for whom 
this arrangement posed ^>edai diffkulties received tutoring on a regular basis from paraprofessionals at the 
project office. 

Project students made frequent use of PLATO, a computer-assisted instruction program that provides 
curricular materials for mathematk^ history, sciem^, and Engl^. 

Science instructk)n emphasized hands-on acthities within a thematic framework. Sodal studies courses 
exposed students to a variety of periodical and audk»vi^iial materials, elidted written responses, and used semantic 
mapping to draw upon the students' pnor knowledge. Mathematks dass^ made frequent use of the computer 
lab. Project students had partkular diflkulty m mathematkrs and science courses. Project staff felt that this was 
the result of i^ucknts' poor eduoilbnal background and their inability to devote sufficient time to homework. 

Instructbnai materials are listed in Appendix B. 

• As a resuh of partkipating in the prc^ram, 70 percent of the students will achieve a passing grade of 
at least 65 in mathematks (Sequential Mathematks) on teadier-made fmal examinations. 

• As a resuh of partkipating m the pn^anv 70 f^r^nt of the students will achieve a passing grade of 
65 or higher in teacher^niade or schoohvide examinations in science (bk>k>gy). 

• As a result of partkipating in the program, 70 percent of the LEP students will achieve a passing 
grade of at least 70 percent in social studies (Gtobal History I and II, and American Government) on 
teacher^ and school-made final examinations. 
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Pasang Grades in Content Area Courses 



FaU 



Spring 



EnroUtnent 



Percent Pi:^in£ 



EnroUment 



Percent Passing 



Matheniaitcs 
Science 
SiKi^l studies 



178 
71 
167 



77.0 
83.1 
90.4 



108 
31 
123 



76,9 
100.0 
74.8 



Project met all three ob^*tives, 

(^arcer j^ducation 

• As a result of parr icipa ting in the prc^am, 70 percent of the students will achieve a passing grade of 
70 or h^her on teaidier-nuide or schoohvide examinatk)ns in Keyboarding 1, 11. 

• As a result of partKnpating in the program, 70 pemnt of the students will achieve a passing grade of 
70 or b^her in BiUngual Occupalk^nal Education 1, 11. 

• As a result of participating in the program, 70 ji^rcent of the students will achieve a passing grade of 
70 or h^her in Computer & Bu^ess Technology on teacher-made final examinations. 

The data wbkrh OREA received did not differentiate among the career education courses for which 
project students received grades. Of the 66 students enrolled in all courses in the fall 90.9 percent passed. Of 
ilie 48 students enrolled in the ^ring, 93.7 percent passed. 

Project met ob,^ctives. 

• As a result of particq)ating in this program, 75 perceut of the students will achieve a passing gr*i .! : of 
75 in jeweliy on teacher-made final examinations. 

Five students took a course m which they denned and made jewehy. All received grades higher than 90. 
Project VB^t objective. 

Participation in Extracurricular ^ivjties 

Project Aprendizaje students participated in an International Food Festival a Sports Night, and a Latin 
Amerkan Festival Project staff nK>derated the Latin American Club, whose more than 70 members were drawn 
predominantly from anK>ng project students. 

• By June 30. 1991, students in the program will have a rate of participation in extracurricular ociivitics 
at least equal to that of the mainstream students. 

The project did not provide data on mainstream students* rate of participation in the sch^rs many 
extracurricular acthities. 

OREA could not evaluate ob^^etive. 
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Attendance 

• By June 30, 1991, students in the program will have a rate of attendance ut least equal to that of the 
mainstream indents* 

Project students bad an attendance rate of 92*19 percent, whereas the »:hoolwide attendance rate was 
81.39 percent. The difference between the proportions was statistkaOy s^nifkant (2<*05). 

Pro^ct imt objective. 
Suspension Rate 

• By June 30, 1991, students in the program will have a sus^nsion rate no greater than that of the 
mainstream students. 

The project reported there had been 40 su^ensk>ns out of 2,095 non-project students (1.9 percent). Two 
project students out of 290 were susf^nded during the ^me perk>d (0.7 percent). 

Project met oljective, 

Dropi^ut Prevention 

The bilingual guidance counsek>r kept an open door for project students. Those with apparent family or 
sixSal proHems were called in for counseling and referred, if necessary, to outside agencies. 

• Program students will have a dropout rate no greater than non-program students. 

The dropout rate for program students was 4,1 percent (N=s=290} and for mainstream students 8.1 percent 
(N^3320). 

Project met objective* 

Staff Development 

• By January 30, 1991, 100 per«nt of Project Aprendizaje personnel will have participated in staff 
development activities, in-servke training workshc^ and departmental meetings. 

The project submitted the minutes from its nK)nthly departmental meetings, at which a variety of 
professional topics were discussed All project staff attended most of these meetings. 

Project met objective* 

• By June 30, 1991, all the educational a$£: *iants will have completed a minimum of six credits toward a 
bachelor^s degree or training in a Held relating to bilingual educatk>n. 

AU the Title VII educational assistants completed at least six credits toward an undergraduate degree. 

Project met objective. 
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• By Jaouary 30, 1991, 100 percent of the professbnal staff wfll have attended a regional or national 
conference, meetings, seminars, colloquiums and workstops in the field of bilingual educatbn. 

AU professbnal staff attended workshops organized by the Office of Bilingual Hducation and by the New 
York Multifunctional Resource Center at Hunter College. 

Project met objective* 

Newsletter 

• By the end of the year, two newsletters will be puUished descnbing the aims, goals, and 
implementation procedures of the program. 

The project published one issue of ^'La Voz Latina," a twelve-page newsletter that included poetry and 
prose by participating students. But^etaiy difBculties prevented the publk:atk>n of a second issue. 

Project partially met oh|ectivt. 

Parental Invoh^ement 

• The Bilingual Parent Advisory Council (BPAC) will have at least four meetings during the school 
year with an attendance of at least SO percent of the BPAC members. 

The project heU four parent meetings but did not report the n.embersbip of the council or record their 
aiiendancc separately from that of the paient-teacher conferences. 

OREA conM not evaluate objeetive. 

• Students' parents will be contacted by telephone, mail, newsletters, or home visits by the family 
assistant to inform them of their children's prc^ram activities. 

The project published a newsletter. The socml worker fulfilled the function of a family assistant, making 
home visits and telephone calls to families when necessary. 

Project met objective. 

• By the end of the school year, there will be an mcrease in the number of parents attending parent* 
teacher day/night conferences. 

The project did not keep rerards for all conferences. 

OREA conM not evaluate objective. 

Support Scrvkes 

• Students with special needs (e.g, academic^ linguistk:, psychok>gical, economic) will meet the guidance 
counsebr at least once monthly. 

The project reported that the bilingual guidam^ counsebr met at least once monthly with those students 
who had academic or psychologkal needs. The project did not report how it identified the students who had 
special needs* 

Project met objective, 
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• All gradimting siudents will meet with the career counsetor for advisement at least four untes during 
the school year or as many times as net^ssary to he^ the student. 

All graduating students m^.. at least four times with the college advimr, who also gave prt«^:niaiions to 
the Ijitin America Chib. 

Project met objective. 
S giPENTS WITH SPECIAL ACADEMIC NEEDS 



Number of Students Percentag e 

Referred to sj^dal education: 0 OS) 

Referred to remedial programs: 0 0.0 

Referred to gifted and talented programs: 0 0.0 

Retained in grade: 26 9.0 

A School^Based Support Team (S.B»S.T), comprbed of an eduratkmal evaluator, a %hool psychologist, 
and a social worker who was bilingual in Spanish evaluated students referred for ^>edal education. Students who 
needed ^>eciai servkes received one daily period of instruction in a bilingual resource room operated by ihc 
special educatk>n staff. 

The project bad no formal programs for gifted and talented students; students had an opportunity lo 
;)ppiy for feltowships to study ballet with the Annabella Gonzalez Theatre and Dance Group. 



MAINSTREAMING 

Nineteen students (6.6 percent of the participants) were mainstreamed at their parents' request after 
scoring above the 40th percentile on the LAB. 

Academic Achievement of Former Pro^ Studet^ts in Mainstream 

Data were not availaMe on the 33 program participants who had l^n mainstreamed in the previous year. 



CASE HISTORY 

Pedro immigrated from the Dominkan Republic in 1^ and entered the ninth grade at Seward Park 
High School that fall. Sini^ he knew some English, he was placed in the second stage of the beginning level of 
H.S.L. He ensiled in his other subjects. He spent most of his free periods in the project office and tutored his 
classmates tbere-first in the content area s^ubj^ and, as hb cmn grasp of Engl^ improved, in E.S.L. Ihe 
courses he took in computer literacy and business education led him to dec^e to pursue (x^mputer science as a 
career field. Attending siunmer school and n^ht school enabled him to graduate early, in June 199 K and he went 
on to City College. 
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APPENDIX A 



DATA COLLECTION AND ANALYSIS 

Student Data Fonq 

Th^ ooe-page form b filled out by staff for each partidpating and mainstreamed student. ORHA gathers 
data from this form on badcgrounds, denK^graphks, academk outcomes, attendance, referrals, and exit from the 
program. 

Project Director's Questionnaire 

The Project Directors Questionnaire imriudes questions on staff quaUftcations, program implementation, 
periods of instruction, and instructional materials and techniques. 

Pmject Director's Interview 

The inteiv^ gathers informatbn on program and student or staff character^tics not supplied by the 
Project Director's Questk>nnaire. The interview also alk)ws proj^ staff to offer qualitative data or amplify 
responses to the Questbnnaire. 

dtvwide Test Scores 

OREA retrieves scores centrally from the Language AsK^ment Battery (LAB) and other citywide tests, 
i or evaluation purposes, these test scores are reported in Normal Curve Equh^aients (N.C.E.s). N.C.E.s are 
normaiized standard scores with a mean of 50 and a standard deviation (s*d*) of 2L06, They constitute an equal- 
interval scale in wbkrh the distance is the same between any two adjacent iKx>res. A gain of 5 N.C.I:. s is the same 
whether it ^ at the km^r or the h^er end of the scale. N.C.E*s can be used in arithmetic computations to 
indicate group progress, (PercentOe scales, although more familiar to many, are unsuitable for such computations 
since they are not equal-interval.) 

Likert-Type Surveyy 

Likert-type surveys, in whkit re^x>ndent5 mark their opmions on a scale from one to five, are used in a 
variety of ways. They examine student attitudes (i.e., t(^ard ^hool and career, native language use, and native 
and mainstream cultures)* They also assess staff and parent attitude and reactions to workshops and other 
activities. 

Ciap Reduction ^valuation Desig n 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where all indents of limited English proficiency 
(LIiP) are entitled to recehre supplementary servkes, OREA compares the progress of participating students with 
that of the group on which the test was normed. It is a^med that the norm group would show a zero gain in 
the absence of instruction* and gains made project students <x>u]d be attnbuted to project services. 
(See "Citywide Test Scores' above.) 

To test whether pre^x^sttest gains are greater than could be expected by chance alone, OREA uses a 
t'test. To determine whether a dilferen<^ bet^en two proportk)0S (e.g., program and mainstream attendancc 
rates) \% greater than could be e!q>&:ted by chance, OREA uses a z-test. The level of significance is set at .05 for 
all tests. 
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APPENDIX B 



INSTRUCTIONAL MATERIALS FOR THE CONTENT AREAS 



SiKiai Studies 



Nueva Historia dc los EE.UU, 

Hisioria Anttpia v Media 

Historia Universal 

Ettn>pa> Africa, Asia, v Australia 

Comprende tu Mundo 

Biliagiial Gtosa^ry of Social Studies 

El Medio Orientc 

China 

Jap6n 



Baker, linden, et at. 
Selzer, Serran-Pagan 
Marl^ 

Martinez, Bartoli 
K. Coc^r 
Kiiloran, Zimmer 
N.Y.C PubUc Schools 
Barron's Educatk>nal Series 
Barron's Educational Series 
Barron^s Educatk>nal Series 
Barron's Educational Series 



Editorial Mincrv'a 

Editorial Minerva 
Editorial Minerva 
Silver Burden 
Jarrett 



(Pamphlets) 
(I^mphlets) 
(Paniqphlets) 
(I^mphlets) 



Mathematfc^ 



Integrated Mathematfcs, Course 1 
Preliminary Mathematics 
Using Computers 



Dressier & Keenan 
I. Dressier 

Elgarten & Pasamentier 



Annsco 
Amsoo 

Addison-Wesley 



Biology 



Biotogi(1986) 
Biologla (1%8) 



Schaerer & Stoltze 
Smallwood & Green 



Allyn & Bacon 
Silver Burdet! 
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